Predicting what will happen in the future is challenging. Researchers from MIT's Computer Science and Artificial Intelligence Laboratory developed an algorithm that can predict whether two individuals will hug, kiss, shake hands or slap five in the next scene. Using a Tesla K40 GPU with the cuDNN-accelerated Caffe deep learning framework, the researchers trained their network on 600 hours of prime-time television shows including The Office and Desperate Housewives. When predicting which of the four actions the person would perform one second later, the algorithm correctly predicted the action more than 43 percent of the time – and humans who have been watching TV for years were only able to predict the next action with 71 percent accuracy. In their second study, the algorithm was shown frames from a video and asked it to predict what object will appear five seconds later.